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Theory learning curve model for estimating the cost of each of these MDAP systems. 
The most suitable of these adds an annual overhead component to the cost modeled by 
the learning effect. This function is implemented in an integer-linear optimization 
model, the Procurement Scheduling Optimization Model (PSOM). PSOM allows the 
planner to specify: an annual budget limit; demand quantities for each system for all 
years in the planning horizon; minimum and maximum annual production rates; earliest 
and latest full rate production (FRP) start periods; and low rate initial production (LRIP) 
costs and quantities. PSOM determines the minimum cost procurement schedule given 
these constraints, finding the optimal quantity of each system to be procured each year of 
the planning horizon. This thesis models the cost of seventeen of the MDAP systems and 
optimally schedules them over an eighteen year planning horizon. PSOM can easily be 
expanded to include all eighty-plus MDAP systems. PSOM is a tool available to 
acquisition planners and decision makers to assist in optimally allocating procurement 
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DISCLAIMER 


The reader is cautioned that the computer programs developed in this research 
may not have been exercised for all cases of interest. While every effort has been made, 
within the time available, to ensure that the programs are free of computational and logic 
errors, they cannot be considered validated. Any application of these programs without 


additional verification is at the risk of the planner. 
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EXECUTIVE SUMMARY 


As the Defense Acquisition Executive, the Under Secretary of Defense for 
Acquisitions, Technology and Logistics (AT&L) has full responsibility for supervising 
the performance of the DoD Acquisition System. A phenomenon that the Office of the 
Under Secretary of Defense (AT&L) has recognized is that the total estimated cost of any 
given defense system increases as the rate of procurement for that system decreases. Ina 
world of unlimited resources, all systems could be acquired at the maximum rate possible 
at the lowest possible cost; unfortunately, we live with the reality of a limited annual 
budget. The decision maker’s dilemma is in choosing how to “best” schedule the 
acquisition of these systems, subject to budget limitations and other requirements. This 
thesis provides the decision maker with a tool to address this problem. 

The most critical requirement of such a tool is that it accurately reflect the 
estimated cost of the systems that are scheduled with it. This thesis uses Selected 
Acquisition Report (SAR) data for seventeen Major Defense Acquisition Programs to 
develop six different cost estimating relationships and evaluate their suitability for this 
purpose. The “Base Model” is simply an expression of basic learning curve theory: each 
system has a “beginning” price per unit which decreases as more units of the system are 
produced. The five other cost estimating relationships are excursions from this model. 
The “Multiplicative-Rate Model,” “IDA Rate-Penalty Model,” and “Linearized-Unit- 
Rate-Penalty Model” all include the rate of production as a predictor of unit cost. The 
“Rate-Change Model” assumes that changes in rate of production from one period to the 
next contribute to the cost of each system. The “Base + Overhead Model” adds a fixed 
cost component to the basic learning curve cost for each lot of the system procured. The 
primary measure of effectiveness (MOE) for comparing each cost estimating relationship 
is how well their predicted lot costs agree with the SAR data lot costs. By this MOE, 
the Base + Overhead Model is the best cost estimating relationship of the six. 

Implementing each cost function in a spreadsheet tool provides additional insight 
into its suitability. The cost functions are used to estimate the annual and total 
procurement costs for the seventeen systems for which we have data. The difference 


between the modeled total cost and the “true” total cost (calculated from SAR data) 
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serves as asecond MOE. By this MOE, the Base + Overhead Model is again superior. 
Although the spreadsheet tool can be used to “manually” adjust the procurement plan for 
each system in search of the least expensive schedule, this is prohibitively tedious. This 
implies the requirement for an optimizing planning tool. 

The Base + Overhead cost function is implemented in an integer-linear program, 
the Procurement Scheduling Optimization Model (PSOM). PSOM is implemented in the 
General Algebraic Modeling System (GAMS), and schedules the quantity of each MDAP 
system to be procured per year over an 18-year planning horizon. PSOM allows the 
planner to specify: an annual budget limit; demand quantities for each system for all 
years in the planning horizon; minimum and maximum annual production rates; earliest 
and latest full rate production (FRP) start periods; and low rate initial production (LRIP) 
costs and quantities. PSOM determines the minimum cost procurement schedule given 
these constraints. Data input to the model requires a working knowledge of GAMS. 

PSOM can be used to construct a chart of the efficiency frontier, a plot of the 
minimum total cost of all systems at varying budget limits. This is built by repeatediy 
solving PSOM ina loop, with the budget decreasing after each iteration, from an amount 
in which the constraint 1s slack to the point at which the model becomes infeasible. The 


efficiency frontier for the seventeen systems modeled in this thesis is presented below. 
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Procurement schedules corresponding to all points above the line are sub-optimal. 
Schedules corresponding to points below the line are infeasible. The decision maker can 
use the information in many ways. Assuming that the current schedule is sub-optimal, 
the decision maker may choose to optimize the schedule for the current budget and thus 
reduce overall cost; or, given an allowable overall cost, the decision maker may choose to 
reduce the annual budget available. If the schedule is already optimal, the decision maker 
will readily appreciate the effect of changing the annual budget limit; the additional cost 
of a reduction in budget, or the potential long-term savings from an increased budget, are 
equally apparent. 

PSOM can be easily expanded to include all 80+ MDAP systems. Expansion and 
use of PSOM or a similar optimization model is recommended for use by acquisition 


planners. 
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I: INTRODUCTION 


In his keynote address to Advanced Program Managers Course 99-02, Dr. Jacques 
Gansler, Under Secretary of Defense (Acquisition, Technology and Logistics) listed three 
“vital priorities” for the DoD acquisition community over the next few years (Gansler, 
1999): 

e To equip the early 21" century warfighter with the right equipment to assure 

our security and withstand any potential threat. 

e To accelerate, broaden, and institutionalize our acquisition reform efforts in 

order to optimize our limited resources in providing those weapons. 
(emphasis added) 

e To modernize our logistics systems -- so as to cut costs, infrastructure, and 

cycle time in support of our 21“ century forces. 

The intent of the second priority—‘in order to optimize our limited resources’ — 


provides the basis for this thesis. 
A. THE CHALLENGE 


A phenomenon that the Office of the Under Secretary of Defense (Acquisition, 
Technology and Logistics) (OUSD(AT&L)) has recognized 1s that the total estimated cost 
of any given system being procured increases as the rate of procurement for that system 
decreases. Asa limited budget forces fewer of each system to be procured per year, the 
systems must be produced at a lesser rate, over a longer period. Either the rate or length 
of production, then, can be considered a contributor to the total procurement cost ofa 
system. If not for the limitation of an annual budget and manufacturing constraints, the 
least costly strategy would be to procure all units of a system in one year—clearly an 
impractical real-world solution. Nonetheless, even considering annual budget limits and 
plant capacities, it is a relatively simple task to determine the optimal procurement 
schedule for a single system. Conceptually, it should also be possible to determine the 
optimal procurement schedule for all systems in combination. This “master” schedule 1s 
much more difficult to find, requiring suitable cost functions to be developed for each 
system and modeling their interactions. The 2001 Quadrennial Defense Review (QDR) 


offers an opportunity to take advantage of scheduling efficiencies if they can be 
] 


discovered. Figure (1) illustrates hypothetically how rearranging a procurement schedule 


could reduce overall cost. 
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Figure 1. Example of Optimized Schedule 
The top chart shows the current procurement schedule for eight MDAP systems. A cost function that 
incorporates the effects of learning and production rates was used to model the cost of each system. The 
bottom chart shows the same total quantity of each system, procured over a more efficient schedule. The 
total cost of all systems in the current schedule is 38,541 CY00$M; the total cost of all systems in the 
optimal schedule is 37,464 CYOO$M. Over a billion dollars is saved. 


During each Quadrennial Defense Review (QDR), the DoD reviews its strategy 
for acquisition of new weapons systems and equipment. Each service and DoD entity 
argues in support of its priority interests. As the Defense Acquisition Executive, 
USD(AT&L) has full responsibility for supervising the performance of the DoD 
Acquisition System. A task of OUSD(AT&L) during the QDR will be to provide an 


economic framework for these decisions. A minimum cost, optimized procurement 
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schedule would be an ideal baseline from which the cost of deviations could be readily 
assessed. Therefore, an OUSD(AT&L) goal is to have developed an optimal Master 
Production Schedule for the DoD Major Defense Acquisition Programs (MDAP) for use 
in the 2001 QDR. This schedule will provide the least costly strategy to purchase MDAP 
systems for the next eighteen years. 

In April 1998, OUSD(AT&L) tasked the Institute for Defense Analysis (IDA) to 
explore the use of optimization technology for long range defense acquisition planning 
(Weber, 1999). IDA was asked to focus on the development of such a Master Production 
Schedule for Acquisition Category (ACAT 1) systems that would meet the following 
requirements: 

e Incorporate the approximately 80 Acquisition Category 1 (ACAT 1) systems 

in development or planned for the future. 

e Cover the 18-year Defense Program Projection (DPP) planning horizon. 

e Serve as an aggregate-level planning tool. The model would be developed at 
the system level, not being concerned with the detailed modeling of systems’ 
components and sub-components. 

e Reflect long-term planning issues, avoiding short-term scheduling issues such 
as assembly line balancing, potential strikes, etc. 

e Reflect existing peacetime conditions to the extent reflected by the DPP (not 
concerned with wartime attrition). 

e Use procurement cost functions for systems that reflect as realistically as 
possible the various factors affecting their values. 

Fulfilling the last of these requirements represents one of the most challenging 
aspects of this effort. Since the cost function for each system is required in both the 
objective function and budgetary constraints of an optimization model, the model will be 
sensitive to the correctness of these cost estimating relationships. 

The optimization model will seek to minimize the total cost of all systems over all 
years, subject to constraints. The most conspicuous of these constraints is the annual 
budget. Other constraints include: the requirement to meet the quantity demanded for 
each system by certain years; limitations on minimum and maximum production rates; 


and the desire to maintain production stability by forbidding breaks in production. The 
3 


model will also allow the user to specify startup and shutdown years, and allow the input 
of Low Rate Initial Production (LRIP) allowances. Figure (2) illustrates a typical 


acquisition schedule for a single hypothetical system. 
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Figure 2. Hypothetical Procurement Schedule for a System 
A hypothetical acquisition schedule for a system starting full rate production (FRP) during period six. 
Quantities produced during low rate initial production (LRIP) are given as data. There are no production 
breaks once started, and LRIP immediately precedes FRP. 


B. PURPOSE 


This thesis develops the cost functions, spreadsheet scheduling tools, and a 
scalable optimization model, for a subset of the MDAP systems that IDA has been tasked 
with including in their model. The systems in the subset, although not selected at 
random, were selected to represent the whole population of MDAP systems. The 
following seventeen systems were selected: 

1. Advanced Amphibious Assault Vehicle (AAAV) 

2. Abrams Tank upgrade 

3. Bradley Infantry Fighting Vehicle (BIFV) upgrade 

4. C-17 Aircraft 

5. CH-47 F Helicopter Upgrade 

6. Crusader Self Propelled Howitzer with Resupply Vehicle 
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7. DDG 51 Guided Missile Destroyer 

8. Evolved Expendable Launch Vehicle (EELV) Space Launch Vehicle 
9. F/A-18 E/F Aircraft 

10. Joint Standoff Weapon (JSOW) 

11. Minuteman III Intercontinental Ballistic Missile 
12. NAVSTAR Global Positioning Satellite 

13. MV-22 Osprey Tilt-rotor Aircraft 

14. SSN 774 Virginia Class Submarine 

15. Standard Missile 2 

16. T-45 TS Aircraft 

17. Trident II Ballistic Missile 


The following additional objectives are accomplished: 


e Modeling six cost functions, to include comparisons between the models 


regarding their respective strengths and weaknesses. 


e Formulation of a mixed integer program in the GAMS algebraic modeling 
language using the most appropriate cost function, with the capability to be 
easily expanded by IDA or OUSD(AT&L) to optimize all eighty ACAT 1 


systems. 
ce THESIS ORGANIZATION 


Chapter II presents the six cost functions. The characteristics of each, the 
assumptions underlying them, and the data analysis which determines the respective 
system parameters for each function is given. The use of spreadsheet scheduling tools 
that use the cost functions developed is explored in Chapter III. The optimization model 
assumptions are listed, the formulation is offered, its implementation is described and its 
output is presented in Chapter IV. Chapter V details analysis of the optimization model 


output and conclusions. 
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Il. COST FUNCTIONS 


Arguably the most crucial step in creating a procurement scheduling tool is to 
derive a sound cost estimating relationship for each system being modeled. The cost 
function must as accurately as possible fit available data, while its behavior must agree 


with our intuition as to what is “correct.” 
A. DATA 


The data required to estimate the cost functions of each system consist of the lot 
quantities and lot costs of each system, from beginning to end of procurement. The data 
for all systems but the Crusader and AAAV was obtained from their respective Selected 
Acquisition Reports (SAR). The SAR data was the most readily available, since IDA 
maintains copies of them. 

A second source of this data is the Procurement Annex of the Future Years 
Defense Program (FYDP), which is a detailed five-year projection of procurements. This 
data mirrors that which is reported in the SARs. Since both the Crusader and AAAV are 
currently still in the RDT&E phase, however, neither their SARs nor the FYDP contained 
their appropriation data. 

A third source of the required data is the DPP, which is less detailed but spans 
eighteen years. The DPP contains the most accurate data available for systems with 
incomplete SAR or FYDP data. Both the Crusader and AAAV data was extracted from 
this source. For each system, the unit cost was recalculated in terms of year 2000 dollars. 


Appendix A shows the data used for each system. 


B. METHODOLOGY 


1. Cost Function Development 

The principal characteristic of a cost function is that as more units of an item are 
produced, the average unit cost of that item decreases. In his book The Cost Analyst's 
Companion, David Lee relates that this phenomenon 1s called “cost progress” and that the 
cost-quantity relation for a given system in production is known as the “cost-progress 


curve,” or “learning curve.” 


One of the most commonly used models of cost progress is the unit theory model. 


The form of this model is 
C(Q) =T,Q° (1) 
where C(Q) is the cost of the O™ unit; 7, and B are constants. The constant 7) is the 


theoretical cost of the first unit produced. The constant B represents the “cost analyst’s 


slope” of the curve, or “slope of the learning curve,” defined by 


Sz Cost at GUBnEY) 20 2) 
Cost at quantity O 

or 

S=2° (3) 


The constant B is assumed to be negative, or the cost or each successive unit would 
increase, rather that decrease. All of the models developed for use in the scheduling 
tools are derived from the Unit Theory Model. Figure (3) shows a typical learning curve 
for a system with theoretical first unit cost 7; of $10 and a learning curve slope of 80%. 
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Figure 3. Typical Learning Curve and Cumulative Cost Curve for a Hypothetical System. 
First unit cost, 7, is $10 and learning curve slope of 80% (f = -0.322). The unit cost of the QO" unit is 
measured on the left axis, the cumulative cost to the QO" unit on the right axis. 
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De Fitting the Data 

The parameters of each cost function are estimated by fitting them to the data 
using least-squares techniques. When possible, data are transformed to log-space, and 
parameters are determined by linear regression. Otherwise, the nonlinear solver resident 
in Excel is used to find the best fit. 

For five of the six cost functions developed herein, the dependent variable of the 
function is the cost of the O™ unit, C(Q). Since the data is given for annual lots, however, 
the dependent variable to be used in place of C(Q) is the average unit cost (AUC), which 
is simply defined as 


AUC = TOTAL LOT COST (4) 
Od SIZE 


The independent variable to be used in place of O is the algebraic lot midpoint (LMP), 
the theoretical unit whose cost is equal to the AUC for that lot on the learning curve. The 
LMP can be approximated using the following rules (AFIT, 1997): 
For the first lot (the lot starting at unit 1): 
If Lot Size < 10, then L/P = Lot Size/2 
If Lot Size => 10, then LMP = Lot Size/3 
For all other lots: 
Pep Ors 
4 


where F is the first unit number in a lot, and L is the last unit number in a lot. 


LMP = (3) 


The sixth cost function is fitted directly to the lot cost and lot quantity, so that 


expressing the data in terms of unit cost 1s unnecessary. 


2: Filtering the Data 

An important issue that must be addressed when considering cost functions that 
include rate of production is the treatment of the first and last production periods. Data 
typically shows a relatively smaller quantity of a system that is produced in the first and 
last periods. One of two interpretations must be assumed: either 1) the rate of production 
is lower in these years; or 2) the first and last lots are not produced over a full year. It is 
more realistic to expect that the second of these assumptions is correct. Therefore, since 


the fractional year is not given in the database, including the first and last production 
y 


periods in the data used for analysis is not usually appropriate for rate-based cost 
functions. For models of this type, we drop the last production period from our data. 
Unless the first production period is obviously a full lot, we drop it from the data also and 
model it as LRIP. 


4. Measures of Effectiveness 
A traditional measure of effectiveness for a linear or nonlinear model is the 


Coefficient of Determination, R’, defined as 


p? =) (RESIDUAL SS) 6) 
(CORRECTED TOTAL SS) 

where 

RESIDUAL SS = ¥ (ry, -¥, | (7) 

CORRECTED TOTAL SS = 9 (Y, -Y,) (8) 


In principle, the R* could be negative if the model fits worse than the mean does. We 
calculate all R? in unit-space, and adjust them to take into account the complexity of the 


model relative to the complexity of the data as follows 
R2, = R? -—_1- R’ 9 
n-K | ) 


where 71S sample size and K 1s the number of parameters 1n the model (Hamilton, 1992). 
Since our interest is in how well the cost functions estimate the systems’ lot costs, 


it is the R’ ad of the fit of the /ot costs that is our principal measure of effectiveness for a 
function. 


c. BASE MODEL 


if Characteristics and Assumptions 

The “Base Model” is simply the Unit Theory model presented in equation (1). As 
previously discussed, this model captures only the effect of learning on system cost. This 
model ignores the production rate. Therefore, whether all units are produced in the first 


period, or production is spread over several periods, the total system cost is the same. 
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2. Model Fit 


The Base Model is the simplest function to fit. Since equation (1) is easily 


transformed to 

InC(Q)=In7,+flnQ (10) 
it is a simple matter to perform a linear regression to obtain the coefficients 7) and £. 
With these coefficients, the annual costs of each system are readily determined. The 
median R’ aa of the fit of the annual costs for this model over all systems is 0.75; the 
mean is 0.65. Parameters for each system and respective Rag values are displayed in 


Appendix B. Figure (4) shows the data and fitted values for the BIFV unit and lot costs. 
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Figure 4. Base Modeling of Bradley Infantry Fighting Vehicle. 


The plot on the top shows unit costs, the plot on the bottom shows lot costs. The fitted values of the bottom 
plot correspond to a Rad of 0.88. 
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D. MULTIPLICATIVE RATE MODEL 


1. Characteristics and Assumptions 

Since the Base Model doesn’t reflect an increase in total cost as production is 
extended over time, we extend it to include the rate of production. Lee describes this as 
the production feature most commonly added, with this form 

C(Q) =T,0° R? (11) 

where R denotes the number of units produced in a production period, and the constant y 
is the rate exponent of the curve. The quantity 2“ is the curve’s “rate slope.” As with £, 
yv is assumed to be negative. This implies that the unit cost of a system decreases as the 
rate at which it is produced increases. We refer to this model as the “Multiplicative Rate 


Model.” Figure (5) shows this cost relationship for the Bradley Infantry Fighting 
Vehicle. 
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Figure 5. Multiplicative Rate Cost Function 
In the Multiplicative Rate Model, both the quantity produced and the rate of production affect the unit cost. 
The chart shows this relationship for the Bradley Infantry Fighting Vehicle, where 7; = 21.790; B= -0.136; 
and y = -0.250 
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2: Model Fit 

Fitting the Multiplicative Rate Model is done in a similar manner as with the Base 
Model, in that equation (11) is transformed to 

nc(Q=ln7,+flnO+7ink il) 

and a linear regression performed to obtain the coefficients 7; , 6, and vy. Results of the 
regressions for each of the systems are summarized in Appendix B. Predictably, the 
Multiplicative Rate Model more accurately fits the data, as compared to the Base Model. 
The median R’ adi for this model over all systems is 0.88; the mean is 0.82. Parameters for 
each system and respective R° adj values are displayed in Appendix B. Figure (6) shows 


the data and fitted values for the BIFV unit and lot costs. 
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Figure 6. Multiplicative Rate Modeling of Bradley Infantry Fighting Vehicle 
Bradley Infantry Fighting Vehicle plots of Data and Fitted Values. Estimated costs are determined by 
Multiplicative Rate Model. The plot on the top shows unit costs, the plot on the bottom shows lot costs. 
The fitted values of the bottom plot correspond to a Rag of 0.91. 
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E. IDA RATE-PENALTY MODEL 


He Characteristics and Assumptions 

The Multiplicative Rate Model possesses the important characteristic that as the 
number of years spent in production 1s extended, the total cost of a system increases. An 
issue for consideration regarding the data, however, is that if the rate of production 
increases through the production periods, rate and quantity can be highly correlated. 
IDA chose not to use this extension to the Base Model due to these perceived statistical 


problems (Balut, 1988). Instead, IDA developed their own cost function, of the form 
» = R 2 
C(Q)=1,0° 1p RR) (13) 


where ois the rate penalty parameter, R* is the theoretically optimal rate of production 
for the system, and F is the actual rate of production for that period. This embellishment 
of the Base Model adds a penalty for production made at other than the optimal rate. 

This is referred to as the “IDA Model.” 

A useful feature of this relationship is that it does not assume that a higher 
production rate is necessarily better. This allows for the possibility of modeling the 
impact of paying overtime costs to increase production in a period, for example. Figure 
(7) shows the per unit and per lot penalties for the BIFV. 
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Figure 7. IDA Rate-Penalty Model Unit and Annual Penalties for Different Rates of 
Production for the Bradley Infantry Fighting Vehicle 
The per unit penalty is 5(R*-R)*/R* , where: R*, the theoretically optimal rate of production, is 190.55 per 
year; R is the actual rate of production; and 4, the penalty constant, is 0.021. 
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The per unit rate penalty in the IDA Model grows quadratically as the production 
rate departs from the optimal rate; that is, a deviation from the optimal production rate is 
penalized more if done in a single period than if divided over several periods. The 
predictable impact of this feature is that large deviations will be avoided. The optimal 
production schedule will tend to divide the total quantity of each system required evenly 


over the periods of procurement. 


7bp. Model Fit 

The IDA Model is more complicated to fit than either of the previous two 
developed thus far. The Excel solver to fit the function parameters in minimizing the 
sum of the squared differences between the data and the calculated average unit cost per 
period. The equation to calculate the average unit cost per period was derived as follows: 
the simple cost progress curve, equation (1), is integrated to yield the relationship 


between the total cost and cumulative quantity produced 


Oe 
T(Q) =——_ 14 
(Q) Pai (14) 
The SAR and DPP data provides the total cost for producing a given lot size. 
Therefore, the above equation is transformed to 
Brt =a B+ 


B+ 


where TLC 1s the total lot cost, Oy is the ending cumulative quantity once the lot is built, 

and Q, 1s the ending cumulative quantity of the previous lot. Adding 0.5 to the beginning 

and ending quantities provides a better approximation to the continuous cost function. 
Dividing equation (14) by R, the size of the lot, yields the average unit cost. To 


this the rate penalty is added as follows 


TN(Qu +0.5P" -(, +0.5)"") .(R'-R (16) 


(B+I1)R R 


where K* is the theoretically optimal rate of production for that system, recognizing that 


AUC = 


R is equal to (Qy—Q,). If R* is not explicitly available from the manufacturer, it is 
either determined by the solver or set at the maximum production rate, depending on 
what the data suggested was most appropriate. The median R’adj for this model over all 


systems is 0.87; the mean is 0.77. Parameters for each system and respective R°adj values 
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are displayed in Appendix B. Figure (8) shows the data and fitted values for the BIFV 


unit and lot costs. 
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Figure 8. IDA Rate-Penalty Modeling of Bradley Infantry Fighting Vehicle 
The plot on the top shows unit costs, the plot on the bottom shows lot costs. The fitted values of the bottom 
plot correspond to a Ro adj of 0.94. 


i: LINEARIZED-UNIT-RATE-PENALTY (LURP) MODEL 


1. Characteristics and Assumptions 
An assumption that the per unit penalty should more correctly be modeled as 
linear leads to a variation of the IDA Model of the form 
clo) = 7,07 + dR’ - (17) 
Under this relationship, the same penalty is incurred for a deviation from the 
optimal production rate whether concentrated in one period or spread over several. 


Figure (9) shows the per unit and per lot penalties for the BIFV. 
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Figure 9. LURP Model Unit and Annual Penalties for Different Rates of Production for 
the Bradley Infantry Fighting Vehicle 
Bradley Infantry Fighting Vehicle penalties per unit and per lot for different rates of production. The per 
unit penalty is 6|R*-R| , where: R*, the theoretically optimal rate of production, is 169.27; R is the actual 
rate of production; and 6, the penalty constant, 1s 0.008. 


ze Model Fit 

Fitting this model 1s accomplished in the same manner as the IDA Model, except 
that the penalty term in equation (16) is replaced with the penalty term in (17). The 
median R’ aaj for this model over all systems is 0.84; the mean is 0.78. Parameters for 
each system and respective Ragj values are displayed in Appendix B. Figures (10) and 


(11) show the data and fitted values for the BIFV unit and lot costs. 
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Figure 10. LURP Modeling of BIFV: Unit Costs 
Bradley Infantry Fighting Vehicle plot of unit Data and Fitted Values. Estimated costs are determined by 
the LURP Model. 
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Figure 11. LURP Modeling of BIFV: Unit Costs 
Bradley Infantry Fighting Vehicle plot of lot Data and Fitted Values. Estimated costs are determined by 
the LURP Model. The fitted values of the plot correspond to a Ro agj of 0.88. 


G. RATE-CHANGE MODEL 


Ie Characteristics and Assumptions 

One can argue that a plant will optimize its production at any rate, given time to 
adapt. Changes in the rate of production between periods, however, prevent this goal 
from being realized. Another Base Model extension that attempts to capture this 


behavior is 
C(Q) = T,0" + d|AR (18) 
where AR is the change in rate from one period to the next. We refer to this model as the 


“Rate-Change Model.” 


2: Model Fit 

The parameters for the Rate-Change Model are determined in the same way as 
those of the rate-penalty models, except that the rate penalty term is replaced by the rate 
penalty term in equation (18). Values for 6 are constrained to be greater than or equal to 
0.001 to ensure that a minimum penalty is assessed for changing production rate. For the 
first production period, AR is defined to be zero. The median R’ adj for this cost function 
over all systems is 0.73; the mean is 0.68. Parameters for each system and respective 
R’ adj values are displayed in Appendix B. Figure (12) shows the data and fitted values 


for the BIFV unit and lot costs. 
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Figure 12. Rate Change Modeling of Bradley Infantry Fighting Vehicle 
Bradley Infantry Fighting Vehicle plots of Data and Fitted Values. Estimated costs are determined by the 
Rate-Change Model. The plot on the top shows unit costs, the plot on the bottom shows lot costs. The 
fitted values of the bottom plot correspond to a R’ag; of 0.79. 


H. BASE + OVERHEAD MODEL 


1. Characteristics and Assumptions 

All of the modifications to the Base Model presented thus far, in some form, 
attempt to capture the effect of production rate. One can argue, however, that the rate 
effect is being confounded with the effect of overhead costs. A low production rate 
extends procurement over more periods, causing overhead costs to be incurred for a 
longer time. The simplest extension of the Base Model uses the learning curve to 


determine the learning portion of each lot cost, and then adds an overhead term to each 


1 


lot cost proportional to the production period. This cost function estimates lot costs 

directly, then, rather than unit costs. The form of this “Base + Overhead Model” is 
B+) 

if (O,,) -(O 


B+! 
where TLC is the total lot cost, Qy is the ending cumulative quantity once the lot is built, 


ILC = 


O, is the ending cumulative quantity of the previous lot, 2 1s the overhead term, and f is 
the fraction of the period in production. Since we cannot consider partial years of 

production, ¢ is always one in our application of the model. Multiple optimal schedules 
that vary the production rate may be determined with this model, but they will all ensure 


that the system is procured in the shortest time possible. 


DF Model Fit 
Since the lot costs are fitted directly for this model, continuity corrections are 


added to equation (19), and the function fitted to the data is simply 


B+ cdl B+! 
TLC = if (O,, +.5) (@; +.5) ro, (20) 


B+ 


The Excel Solver is used as with the rate penalty models to determine the parameters for 
each system. The overhead term, 92, is constrained to be greater than or equal to 1; this 

forces a minimum penalty for producing over an additional period. The median Radi for 
this cost function over all systems is 0.90; the mean is 0.86. Parameters for each system 
and respective Radi values are displayed in Appendix B. Figure (13) shows the data and 


fitted values for the BIFV unit and lot costs. 
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Figure 13. Base + Overhead Modeling of Bradley Infantry Fighting Vehicle 
BIFV plots of Data and Fitted Values. The fitted values of the plot correspond to a Ro ogj of 0.93. 
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|e INITIAL COMPARISON OF MODELS 


Using the median and mean Rad for each cost function, the models are compared. 
Figure (14), a series of box plots for each model, summarizes the models into a useful 
visual tool for determining which is the most suitable. The most recently presented 
model, Base + Overhead, exhibits the highest median Rad and also has the least 
variance. This can be considered the “best-fitting” model, followed, in order, by the 
Multiplicative Rate Model, the LURP Model, the IDA Rate-Penalty Model, the Base 
Model, and the Rate-Change Model. At this point, both the Rate-Change Model and the 


Base Model can be dropped from consideration for use as scheduling tools. 
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Figure 14. Box Plots of the Systems’ R’ag Values for Each of the Cost Models Explored 
Medians are labeled within the plots, means are labeled below the respective model name. The Base + 
Overhead model can be considered the “‘best-fitting” overall, as it yields the highest median R’ aaj, mean 
R’ adj and the lowest variance. 
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Il. SPREADSHEET SCHEDULING TOOLS 


A. INTRODUCTION 


A worthwhile step before implementing a cost function in an optimizing program 
is to exercise it in a spreadsheet. In this manner we can confirm our beliefs as to how the 
function behaves, and perhaps gain further intuition as to how it will work in a math 
program. A strength of spreadsheets is that they can easily model complex relationships 
that are difficult. if not impossible, to implement in an optimization model. Elements of 
interest when employing our cost functions are: 1) how well the function estimates the 
current estimated total cost, given the current procurement schedule; 2) how the schedule 
“behaves” in moving towards optimality; and 3) to what degree the total cost is reduced 
when the schedule is “optimal.” As a baseline, refer to Figure (15), a depiction of 
current projected acquisition costs derived from the data. The plot shows the total yearly 
cost if the seventeen systems are produced on currently anticipated schedules with 
currently anticipated costs. These costs will be called “true” since none of the estimation 
models of Chapter II are involved. 
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Figure 15. Cost of Current Procurement Schedule 


Cost of current procurement schedule, by system, over eighteen year planning horizon (taken from data). 
The total cost of all systems will be $158,483 (CYO0$M). The plot provides a baseline from which the 
effect of using the cost functions of interest can be readily observed. 


aS 


As the spreadsheet model does not automatically enforce budget and production 
constraints, the user must ensure that they are observed. Because future needs are 
unknown, imposing a yearly constraint may not necessarily be wise; nonetheless, budget 
limits are a key feature of our model. In the following experiments with each cost 
function, annual budget constraints are relaxed while observing the production 
constraints. Bounding annual production rate constraints requires careful judgment by 
the modeler. If these limits are not provided, as in this situation, they must be 
extrapolated from the data available (Appendix A). For each system, the highest 
observed annual quantity procured is used as the maximum production rate. The 
minimum production rate is chosen much more subjectively; this constraint is essentially 


a control over production stability. Table (1) lists the maximum and minimum annual 


production rates used in the modeling efforts for each system. 





Table 1. Estimated Maximum and Minimum Annual Production Rates 
B. MULTIPLICATIVE RATE MODEL 


Using the Multiplicative Rate Model to determine the costs of the current 
procurement schedule yields a total cost of $153,241 (CYOO$M). This is an 
underestimate of the true cost by 3.31%. A plot of the procurement costs as determined 


by the model is virtually indistinguishable from the data plot in Figure (14). 


Experimentation confirms the expectation that as the rate of production increases, 


unit costs decrease. The minimum total cost is achieved when each system is produced at 
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maximum rate, until the quantity demanded is satisfied. Furthermore, it is most 
beneficial to delay any reduction in production as long as possible. Disregarding annual 
budget limits, the optimal procurement schedule simply produces every system at 
maximum rate, except during the last period. Figure (16) shows the least costly 
procurement schedule as determined using the Multiplicative Rate Model. The total 
estimated cost of this schedule is $146,489(CY00$M), a difference of $6,752(C YOO$M) 
from the estimated current cost. Since this schedule did not consider annual budget 
limits, this difference serves as an upper bound on the savings that could be expected. 
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Figure 16. Cost of Optimal Procurement Schedule as Determined Using the 
Multiplicative Rate Model 


The model schedules production at the maximum rate, until demand has been satisfied. The total cost of all 
systems is estimated to be $146,489 (CYO0$M). This represents a savings of $6,752 (CYO0$M) compared 
with the current schedule. 


c. IDA RATE-PENALTY MODEL 


The IDA Rate-Penalty Model yields a current-schedule total cost of $156,275 
(CYOO$M), an underestimate of the true cost by 1.39%. This is a slight improvement 
over the Multiplicative Rate Model. As mentioned earlier, when forced to produce at 
below optimum rate, this model seeks to divide the quantity required equally over the 


time allotted. Table (2) illustrates this property with a simple example. 


US 


Total 
Current Rate 90 90 90 90 40 
Unit Penalty 10 10 10 360 
Lot Penalty 900 900 900 14400 18000 
Current Rate 


Unit Penalty 





Lot Penalty 


Table 2. IDA Rate-Penalty Model Unit and Annual Rate Penalties 


Unit and lot rate-penalties for a five period hypothetical procurement schedule. The total quantity procured 
is 400. In this situation, the system is limited to producing 90 per period vice its optimum of 100. 
Producing at this maximum for four periods exposes the schedule to a severe penalty in the fifth period. 
The least costly solution divides the penalty evenly over the five periods. 


An adjustment that is used in the spreadsheet implementation of this model is to 
eliminate the rate-penalty term of the cost function for the last period of production. 
Otherwise, as just discussed, the system would never be produced at the optimal rate, 
even when unconstrained by budget or rate limits. By eliminating the penalty for the last 
period, it is tacitly assumed that the system is produced at the optimal rate during a 
fraction of this period. 

The optimal schedule, then, produces each system at its optimal rate, thus 
incurring no rate-penalty. The total cost of such a schedule will be the same as if it had 
been modeled using the Base Model. The total cost of this schedule is $148,824 
(CY00$M), allowing an upper bound of $7,451 (CYO0$M) in savings from the estimated 
cost of the current schedule. The plot of the IDA Rate-Penalty optimal schedule is nearly 
identical to that of the Multiplicative Rate Model shown in Figure (16). 


D. LURP MODEL 


The LURP Model yields a current-schedule total cost of $155,674 (CY00$M). 
This is an underestimate of the true cost by 1.77%. As with the IDA Rate-Penalty Model, 
the penalty term is dropped from the last production period. Unlike the IDA Rate- 
Penalty Model, this model seeks to produce at as close to optimal as possible, for as many 


periods as possible; table (3) illustrates this property. 
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R*= 100 PERIODS Total 


90 90 90 90 40 


Current Rate 





Unit Penalty 100 100 100 100 600 
Lot Penalty 9000 9000 9000 9000 24000 60000 
80 80 80 80 80 
Unit Penalty 200 200 200 200 200 
Lot Penalty 16000 16000 16000 16000 16000 80000 
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Table 3. LURP Model Unit and Annual Rate Penalties 
Unit and lot rate-penalties for a five period hypothetical procurement schedule, calculated with the LURP 
Model. The total quantity procured is 400. In this situation, the system is limited to producing 90 per 
period vice its optimum of 100. Unlike the IDA Rate-Penalty Model, this model seeks to produce at as 
close to optimal as possible, for as many periods as possible. Dividing the penalty evenly over the five 
periods, the preferred solution for the IDA Rate-Penalty Model, is more costly. 


Producing at the optimal rate for each system and period, without regard to budget 
limits, provides the minimum achievable total cost. The plot of the LURP optimal 
schedule is also nearly identical to that of the Multiplicative Rate Model shown in Figure 
(16). The total estimated cost of this schedule is $143,965(C YOO$M), a difference of 
$11,709(C YO0$M) from the current cost estimated with the same function. Again, since 
this schedule did not consider annual budget limits, this difference serves as an upper 


bound on the savings that could be achieved. 
E. BASE+OVERHEAD MODEL 


The Base + Overhead Model yields a total cost of $159,683 (CYO0O$M). This is 
an overestimate of the true cost by only 0.76%, the closest of the four functions modeled 
with spreadsheets. This is also the simplest of the four functions. The same overhead 
cost is included in the lot cost if any units are procured, regardless of the quantity, 
including the last production period. A tacit assumption is made that the final production 
period incurs the same overhead as a full period. There is no unique optimal solution to 
this scheduling exercise, since any combination of quantities that completes production in 
the shortest amount of time will incur the same cost. 

Figure (17) illustrates one optimal solution determined using this function. The 
total procurement cost over this schedule is $155,407 (CYOO$M). This is only $4,276 
(CYO0$M) less than the estimated cost of the current schedule. 
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Figure 17. Cost of Optimal Procurement Schedule, Determined with the Base + Overhead 
Model 


The same overhead cost is included in the lot cost if any units are procured, regardless of the quantity, 
including the last production period. There is no unique optimal solution to this scheduling exercise, since 
any combination of quantities that completes production in the shortest amount of time will incur the same 
cost. The total cost of all systems is estimated to be $155,407 (CYOO$M). This represents a savings of 
$4,276 (CY00$M) compared with the current schedule. 


F. FURTHER COMPARISON OF MODELS 


Of the four functions implemented in spreadsheet applications, only the Base + 
Overhead Model overestimated the total cost of the current procurement schedule. The 
0.76% error of this function’s estimate is the smallest of the group in absolute value. 
Additionally, the potential savings from optimal scheduling is the lowest. It is reasonable 
to argue that the Base + Overhead Model is the most conservative of the four. Table (3) 
summarizes the statistics of interest for each of these models. 
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Table 3. Summary of Measures of Effectiveness of the Four Best Cost Models 
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G. “OPTIMAL” SPREADSHEET SOLUTION 


The most accurate spreadsheet tool is selected based on the Base + Overhead cost 
function, for schedule planning. Using this tool, one can attempt to determine the 
optimal procurement schedule subject to any annual budget constraint. An estimated 
budget amount that will serve as a basis for later comparison, derived simply by 
estimating the largest annual cost from Figure (15), is $16,000 (CYO0$M). Figure (18) 
shows the least costly schedule that the author was able to derive after several hours of 
experimentation and manipulation. The total cost of all systems on this schedule is 
estimated to be $159,159 (CY00$M), only $524 (CY00$M) less costly than the current 
schedule. Although the spreadsheet planner is useful for visualizing procurement costs, 
using it to find an optimal schedule is impractical and tedious. 
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Figure 18. Schedule “Optimized” using Spreadsheet Planning Tool 
The least costly schedule that the author was able to derive after several hours of experimentation and 
manipulation. The unconstrained optimal solution is used as a starting point, and lot quantities of various 
systems are changed until annual budget constraints are met. The total cost of all systems on this schedule 
is $159,159 (CYO0$M), which is only $524 (CY00$M) less costly than the current schedule. 
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BY: OPTIMIZATION TOOL 


The time required in manipulating the spreadsheet tool, coupled with the lack of 
improvement over the current schedule, reinforce the belief that a truly optimizing 
planning tool is required. All of the cost functions developed herein are inherently 
nonlinear, however, a hindrance to optimization modeling. Fortunately, in addition to 
being the best fitting of the cost functions explored, the Base + Overhead cost function is 
the simplest to approximate linearly. This cost function is implemented in an optimization 


model, henceforth called the Procurement Scheduling Optimization Model (PSOM). 
A. LINEARIZING THE COST FUNCTION 


The nonlinear portion of the Base + Overhead cost function, equation (19), is the 
learning effect term, which is linearized using a step function. This is accomplished for 
each system, using the following steps: 1) the cost of each unit is determined using the 
Base Model; 2) the mean cost of the units yet to be procured is determined; 3) this set of 
units 1s divided into two subsets: the first consisting of all units of above average cost; the 
second consisting of units of be/ow average cost; 4) both of these subsets are further 
divided into two groups in the same manner, yielding a total of four groups; and, lastly, 
5) the mean unit cost of each group is assigned as the price for every element in that 
group. This method of dividing the set of items to be acquired attempts to weigh the size 
of each group appropriately, contributing to a good deal less error than the standard 
technique of dividing them into groups of equal number. Although somewhat more of a 
demanding procedure, the task is easily accomplished in a spreadsheet. Figure (19) 
illustrates the process described above. Figure (20) shows the cumulative cost curve of a 
system priced using the Base Model versus the same system using a step function 
approximation. Implementing the step function approximation into a spreadsheet 
computes a cost of $160,546 for the current procurement schedule. This is a represents a 
slight increase in error, which is to be expected, an overestimate of the true cost by 


1.30%. 
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Figure 19. Linearization of the Learning Curve Using a Step Function 
The average unit cost of the systems yet to be procured is determined. The set of units to be procured is 
divided into two subsets: the first with units of above average cost, the second with units below average 
cost. These subsets are further divided in the same manner as the original set, yielding a total of four 
groups. The average unit cost of each group is assigned to every item in that group. 
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Figure 20. Cumulative Cost of a System: Base Model vs. Step Function 


Comparison of cumulative system cost as determined by the Base Model and its step function approximation. 


The system shown has a T, of 20 and learning curve slope, exaggerated for clarity, of 71% ( § = -0.5). 
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B. MODEL FORMULATION 


1. Introduction 

PSOM 1s an integer-linear program that recommends the quantity of each MDAP 
system to be procured in each year of the DPP. PSOM carries the same assumptions as 
the Base + Overhead cost which it employs; the most significant of these 1s that periods 
are measured in years, with partial periods of production not allowed. Thus, the 
overhead incurred when a system is in production is the same for each year. 

The model uses both binary and continuous variables to achieve a balance of 
realism and solvability. Binary variables are used to indicate the start periods and 
periods of full rate production (FRP) for each system. Additional binary variables are 
used to control the step function approximation of the cost function. Although 
procurement quantities must be integers in reality, they are represented by continuous 


variables to expedite solution. 


me Formulation 
Indices 
system 
ee time period {/...N} 
Pp LRIP period {/...M;} 
"5 cost level {/...4} 
Data 
N number of periods under consideration in this model 
M; number of LRIP periods for system 7 
CLIP, number of units 7 in LRIP period p 
Ci. procurement cost of system 7 in LRIP period p 
RICE unit cost of system 7 at cost level c 
OVERHEADi fixed cost incurred by system 7 if in FRP 
MINBUY;, quantity of system 7 that must procured at cost level c before they 
may be procured at cost level c + / 
BUDGET, annual budget constraint 


DEMAND ir 
INV; 


required minimum quantities of system 7 by period f 


Starting inventory of system 7 in period 1 


MINRATE; minimum sustaining production rate for system 7 during FRP 

MAXRATE; maximum production rate for system i during FRP 

EARLY; earliest period in which FRP may begin for system i (> M4, ) 

LATE; latest period in which FRP may begin for system i( < NV) 
Variables 

Git units of system 7 procured in period ¢ 

Start iy {1 if system 7 begins FRP in period f¢, else 0 

Sr Dit {1 if system 71s in FRP in period f, else 0 

Vite {1 if system 7 is available at price level c in period tf, else 0 

CUMG it cumulative units of system 7 procured by period f 

COStit cost of all units of system 7 procured in period t 
Formulation 


MINIMIZE: > > cost, 


SUBJECT TO: 
Budget 
cost, = > GiePRICE,, + frp, OVERHEAD, 


Demand 


+ YS CLRIP, (startin) Viet (Cl) 
i p=l 
BUDGET 2) cost, Vt (C2) 
t M, 
cumgq,, = INV, +> > Get Y do L RIP. , (start, tee a Vi,t (C3) 
fee] 7s ler 
cumq, 2 DEMAND, Vi,t (C4) 
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Production Rates 


Yue = SP, MINRATE, Vist 


> 4 S frp, MAXRATE, Vist 


FRP Start 
> t(start, )> EARLY, Vi 


f 


> c(start, )< LAD ea) 


f 


No Production Breaks 
»_ start, =i Wi 


FRP Start/Production Status Integrity 
Start, 2 (fp, oe lider) Vit 


Step Function Approximation and Buy Limit per Cost Level 
Yin MINBUY, <> Gin S$ MINBUY, Vit 
=] 
Vin M INBUY,, <> Gi S MINBUY,y,, Vit 
f=1 
y,3MINBUY,; $ ¥4,3 $ MINBUY sy, Wit 
=) 


Via MINBUY,, SD) G44 S$ MINBUY,,y,, Vit 


=] 


Variables 


G;,-ncuimgrncost, 20 VEE 
{iday 4 start, ? Dic S {0,1} Vit 
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(CS) 


(C6) 


(C7) 


(C8) 


(C9) 


(C10) 


(C11) 


(C12) 


(C13) 


(C14) 


(C15) 
(C16) 


3: Explanation of Constraints 
Constraints (C1) define the cost of all units of system i procured in period f¢, coSt;,. 
The most complicated term in these constraints is the “LRIP term” 


M, 
» » CLRIP,, (start, ae )} tak 


i p=l 
which is the LRIP costs in time period ¢ due to LRIP for system i. A hypothetical system 


with three LRIP periods, a first LRIP period cost of X, and FRP beginning in period six 
provides an exampie (we omit the 7 subscript for brevity): 

M=3; CLRIP; =X; starts= 1 
we see that in time period ¢ = 3, the LRIP cost 1s 

CLRIP, (start say -p))= X (starty),5,3-1 = X (start, )=X*1=X 

as is required. Similar results are obtained for LRIP periods 2 and 3 during time periods 
4 and 5 respectively. | 

Constraints (C2) ensure that costs per year never exceed the annual budget. 
Constraints (C3) define the cumulative quantity of each system procured by period f¢, and 
Constraints (C4) ensure that this quantity meets demand. Constraints (C5) and (C6) 
ensure that annual rates of production are maintained between their respective upper and 
lower limits. Constraints (C7) and (C8) imposed a window of allowable periods in 
which FRP may begin (} (start, ) is simply the FRP start period for system i. ) 
Constraints (C9) make ee that there are no breaks in production. Constraints (C10) 
maintain consistency between the indicator variables for sfart;, and frp; Constraints 
(C11) through (C14) enforce the step function approximation to the learning curve. The 
binary variables y;, ensure that all of the more expensive units are procured in the 
required quantity before allowing the next less expensive units to be procured. This is the 


same “toggling’’ technique used by Loerch (1997). 


oF IMPLEMENTATION AND ANALYSIS 


Ae Implementation 
PSOM is implemented in the General Algebraic Modeling System (GAMS) 
[Brooke et al. 1997] with the CPLEX solver, Version 6.5 [ILOG 1999]. Over an 18-year 


planning horizon seventeen MDAP systems are scheduled, at four cost levels. The model 
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has approximately 11,000 equations and 3,500 variables, of which 1,600 are binary. 
Appendix C is the GAMS implementation of PSOM. 

PSOM is a mixed-integer linear program, and is solved by branch-and-bound 
enumeration. The time required to solve each run of the model is influenced by the 
relative integer termination tolerance; this is the difference between the best integer 
solution and the best known lower bound, divided by the absolute value of the best 
integer solution. With a relative tolerance of 0.001, PSOM generally runs in less than 
seven minutes on a personal computer equipped with a Pentium I] 333 MHZ processor 
and 296MB of RAM. With a relative tolerance of 0.0005, the mean time to solve is 
increased to 15 minutes. While a relative tolerance of one tenth of one percent certainly 
represents a higher fidelity and resolution than the underlying input data, we used a 
0.0005 relative tolerance to more accurately compare model results at varying budget 


levels. 


ae Computational Results 

Since the seventeen systems modeled by PSOM are only a subset of the eighty- 
plus systems that comprise the MDAP population, there is no accurate budget amount to 
input to the model. We use the annual budget amount of $16,000 (CY00$M) derived 
earlier and used in our spreadsheet “optimization.” At this budget level, PSOM 
determines the optimal schedule depicted in Figure (21). PSOM minimizes cost by 
eliminating as much overhead as possible. Total cost of this schedule, as determined by 
GAMS, is $156,297 (CYOO$M); this is 0.26% more than the spreadsheet-calculated cost 
of the same schedule, which we attribute to rounding and linearization error. Comparing 
the cost of the current to the optimal schedule, a potential savings of $3,792 (CY00$M) is 
revealed. Additionally, we notice that this is $3,268 (CY00$M) less than the least costly 


spreadsheet-determined schedule. 


6) 


PROCUREMENT COSTS PER YEAR 
OPTIMAL SCHEDULE AT < $16,000 


$20,000 
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Figure 21. Optimal Schedule at Current Budget Level 
The optimized procurement schedule at the current estimated annual budget limit. The optimized schedule 
represents a potential savings of $3,792 (CYOO$M) over the current schedule. 


PSOM can be used to construct a chart of the efficiency frontier, a plot of the 
minimum total cost of all systems at varying budget limits. This is built by repeatedly 
solving PSOM in a loop, with the budget decreasing after each iteration, from an amount 
in which the constraint is slack to the point at which the model becomes infeasible. A 
simple modification to PSOM, in which the budget is minimized vice the total cost of all 
systems, reveals the absolute minimum annual budget to be $12,714 (CYO0$M). Figure 
(22) is the efficiency frontier for this procurement schedule. Procurement schedules 
corresponding to all points above the line are sub-optimal. Schedules corresponding to 
points below the line are infeasible. The decision maker can use the information in many . 
ways. Assuming that the current schedule is sub-optimal, the decision maker may choose | 
to optimize the schedule for the current budget and thus reduce overall cost; or, given an 


allowable overall cost, the decision maker may choose to reduce the annual budget mi 





available. If the schedule is already optimal, the decision maker will readily appreciate ; 
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additional cost of a reduction in budget, or the potential long-term savings from an 


increased budget, are equally apparent. 


TRADEOFF BETWEEN ANNUAL BUDGET 
AND TOTAL PROCUREMENT COSTS 


$159,000 - 


$158,500 


$158,000 





$157,500 


$157,000 


$156,500 


Total Procurement Costs (CYOO$M) 





$156,000 





SG SISO0 | eee ee ee 
$12,000 $14,000 $16,000 $18,000 $20,000 $22,000 
Annual Budget (CYO0$M) 


Figure 22. Efficiency Frontier for MDAP Procurement Schedule 
Procurement schedules corresponding to all points above the line are sub-optimal. Schedules corresponding 
to points below the line are infeasible. Assuming that the current schedule is sub-optimal, the decision maker 
may choose to optimize the schedule for the current budget and thus reduce overall cost; or, given an 
allowable overall cost, the decision maker may choose to reduce the annual budget available. If the schedule 
is already optimal, the decision maker will readily appreciate the affect of changing the annual budget limit; 
the additional cost of a reduction in budget, or the potential long-term savings from an increased budget, are 
equally apparent. 
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Ve CONCLUSION 


Of the six cost functions derived from the Unit Theory Model (equation 1), the 
Base + Overhead Model is most suited to this purpose; it shows the best fit to the data, 
most accurate estimate of current total cost, and is the simplest to implement in an integer 
linear program. PSOM uses this relationship to determine the annual procurement costs 
of the MDAP systems that it schedules. 

PSOM allows the analyst to specify: an annual budget limit; demand quantities 
for each system for all years in the planning horizon; minimum and maximum annual 
production rates; earliest and latest FRP start periods; and LRIP costs and quantities. 
PSOM determines the minimum cost procurement schedule given these constraints. Data 
input to the model requires a working knowledge of GAMS. 

Perhaps the most illuminating product that PSOM can determine 1s the efficiency 
frontier for the schedule cost versus the annual budget limit. This allows a decision 
maker to visualize the tradeoff between total and annual costs. 

PSOM can be easily expanded to include all 80+ MDAP systems, with some 
slowing of solution time. Solution times can be reduced by manipulating the model’s 
relative termination tolerance, while maintaining the required fidelity of the model 
solution. Thus, PSOM is a useful tool available to acquisition planners and decision 
makers. Expansion and use of PSOM or a similar optimization model is recommended 


for the upcoming and subsequent QDRs. 
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APPENDIX A: DATA 


Bradley CHAT [Crusader 


YEAR TOY] Cot [Cy] Com [OH] Com [OH] Coa [OH] Coat [OH] Coa 
i Se ae 
i 
nn a ae ee ae 
ee | ae | mens ee 
Fl 
a = 
Fs 
2 EA 
OE: 
5 CX: Ey 
1995 [4828.00 a 
[1996 | 900 sa7.0§ 8298.38 +s 
- il 

ae. 

_—s 

—a 


[ise | «i 20 a9 STIG 9 2046} 
(1998 [20 S018 776.2973 BTS 

1999 | 206983973 DES RE 1S BHI. 

[2000 [920 649.22) TOS 3759912 28359 

[2007 | 058385 16349608 TS STA 


2002 |__| 90 879.0%] 181 476.ai] 9.22784) 7110628 
2003 [88 

004 [2888.58 2082.88 27 278.20) 6258.00 
[2005 [382404 28S SERA 9 28GB TAA_877.BO 
[2006 | 200 719459 | 288 4B7AY 28 _208.82] 180 7250.00 


[2007 [200 7004.49 | 786 396.09 [28 204.09) 240 7280.00 
[2008 [20095049 | («28 200-73] 240 727600 
[2008 | 2009266928987 79) 240 -7776.00 
200 [72 6979 | C28 184.85] 240 7768.00 
pao 28998106280 1168.00 
SSO WZ 
a0 | = 4 == oe 
a 
i a a a 
8 a a ce el 
Lh a a a a 


Table Al. Data for AAAV, Abrams, Bradley, C-17, CH-47F, and Crusader 
All costs CYOOSM 


Minuteman 


ae DDG-51 Betty FA-18 E/F JSOW 


NAVSTAR 


ae ae — 





1986 —_— 
1986 ee | 
1987 ae: hil 
i988 a a a 
(1989 | 4 3407.58 eg Se A ea 

Pio [sama 

war [4 35a i — 

529303 Se 

a i 

1994 anne ss 

1996 eh aaa 

cc: 


USMS 3 2823.24 12 2125.34 100 66.03) 10 64.71 


1993 3 2769.90 2OR2165 90M So ee7o. 17 50 106.12 
1999 3 2846.09 30 2844.57, 328 116.49) 39 105.67 


2000 ZN faleoO 67.60, 36 2821.15 454 111.18 65 183.76 


2001 2 2038.16 4 351.25) 42 2913.62} 636 161.40) 80 190.29 = 
2002 2 2009.54 5 430.90! 45 2848.91, 747 170.09} 80 180.95 = | 


2003 1 tZ76-99 TWAS, 48 2912.05 709 162.00} 80 190.52 
2004 P ee 7 476.04 48 2923.52) 603 128.56) 80 181.29 
2005 ~ 6 393.24 48 2937.16 504 99.59) 80 178.93 


2006 Se | 12 1121.46 48 2835.76 893 163.21) 80 182.08 


3 329.80 
3 2386107, 


3 243.5 
32500 


2007 Le. @ 11 769.02} 48 2756.44 981 183.97; 24 106.91 3: (22e50e 


[2008 |S 08.848 7720.23 7S TAA |S BT 
(2008 |S 8r7 148 2606.99 67S SATS (80B 
2010 | __ a8 7807] 27 T703G 7S T0387 CSCS (DO 
A A: 
[201 [ae] 51947 
5 A: 
1s a 2 | 
201 | 285.99 a 
cs IZ 


2017 | | 460.52 


2 21 a 


Table A2. Data for DDG-51, EELV, FA-18 E/F, JSOW, Minuteman IJ, and NAVSTAR 


All Costs CYOOSM 
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| 









[Taney 

LI a a 

a 

| 

a a 

ke Rl A 
a 













5S 56 80 103.39 


1988 5256.0 
1999 
7000 


(2006 [30 1480.37 2 3097.58 1207000075 30220 
(2007 [301428673 4928.79 150 T1899 1S SIT 


2008 30 1475.09 3 4876.27, 175 128.80) 15 341.70 
2009 30 1449.93 3 4463.93} 190 133.97, 12 274.86 


2010 | 32 161894 3 AGNI Tas TOTTI 
ror [ae vere 7 aera 
2012 | se eee Tse 
201s [so iweeg Ss zee} TC 
pao |e are 
ES net 
0 


W 































Table A3. Data for MV-22 Osprey, SSN 774, Std Missile 2, T45TS, and Trident I] 
All Cost CYOOSM 
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APPENDIX B: FUNCTION PARAMETERS AND FIT 


BASE MODEL 
MEASURE OF FIT AND PARAMETERS 


ae 


CH-47F 0.95 20.84342 -0.20234 
Crusader 0.91 16.86318 -0.17437 
DDG 51 0.67 1121.24115 -0.04546 
EELV 0.42 93.88424 -0.06959 
FA-18 E/F 0.65 222.60646 -0.22781 
119.00257 -0.15928 

Std Missile 2 0.79 34.58983 -0.54884 


Trident II 77.10653 -0.15422 


MEDIAN 0.75 
MEAN 0.65 


Table BI. Base Model R’agj and Fitted Parameters 
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MULTIPLICATIVE RATE MODEL 
MEASURE OF FIT AND PARAMETERS 


Abrams Upgrade 163.449 -0.07840 -0.62766 


[casa 80a [ores as 


FA-18 E/F 541.808 -0.12197 -0.39134 
JSOW 0.88 2.550 -0.23668 -0.09960 
Minuteman III 17.501 -0.01105 -0.44964 


MEDIAN 0.88 
MEAN 0.81 





Table B2. Multiplicative Rate Model Rag; and Fitted Parameters 
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IDA RATE-PENALTY MODEL 
MEASURE OF FIT AND PARAMETERS 


system [tetas || 
Abrams Upgrade 0.03 -0.19414 120.000 


CA17 322.087 -0.08388 19.90869 15.000 
CH-47F | 0.96 20.961 -0.20174 0.00100 26.000 


17.939 -0.18500 0.00947 240.000 
DDG 51 1001.187 -0.06159 161.49438 


EELV 95.430 -0.07374 0.00100 13.000 


MV-22 Osprey 0.95 0.46394 30.000 


T-45TS 61.104 -0.19889 0.23579 12.000 


Trident I 105.786 -0.46859 16.36435 Bgss 


MEDIAN 0.87 
MEAN 0.77 


Table B3. IDA Rate-Penalty Model R°adj and Fitted Parameters 






































49 


LURP MODEL 
MEASURE OF FIT AND PARAMETERS 


AAAV 6.753 -0.04671 0.00489 200.000 
Abrams Upgrade 16.985 -0.19390 0.02440 120.000 


erare [ae [anatase [sora aa 


EELV 0.89 95.426 -0.07373 0.00100 13.000 


FA-18 E/F 261.403 -0.26458 0.00100 48.000 
JSSOW -0.25164 0.00014 675.000 
Minuteman III 10.488 -0.27319 0.00100 80.000 


NAVSTAR 0.55 123.303 -0.16641 0.00000 3.000 


MV-22 Osprey 154.603 -0.21427 0.47396 30.000 


SSN 774 1451.865 0.00000 306.01032 3.000 
Std Missile 2 28.683 -0.53104 0.00178 141.829 
T-45TS 61.960 -0.20159 12.000 
Trident Tl 94.346 -0.64826 968116 9.243 
— 0.84 
MEAN 0.78 


Table B4. LURP Model R“ag; and Fitted Parameters 
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RATE CHANGE MODEL 
MEASURE OF FIT AND PARAMETERS 


a 
AAAV 8.315 -0.08823 0.00330 
aero | a ee 
ee | ae 
Crusader 0.86 -0.21566 0.00100 
FA-18 E/F 0.52 261.482 -0.26463 0.00100 


Minuteman III 9.261 -0.25777 0.03262 


NAVSTAR 0.55 123.303 -0.16641 0.00000 
MV-22 Osprey 176.229 -0.23353 0.05506 


SSN 774 | 0.69 2529.798 -0.16309 91.60310 


Std Missile 2 0.73 38.029 -0.56567 0.00100 
MEDIAN 0.73 
MEAN 0.68 





Table B5. Rate-Change Model R74 and Fitted Parameters 


a1 


BASE + OVERHEAD MODEL 
MEASURE OF FIT AND PARAMETERS 


[Roars Urwase | e60 | ss7_ [pam aaa 
[aa [eat rm 
[ora [or 
DDG 51 648.006 -0.01373 980.791 


EELV 104.930 -0.09306 1.000 


FA-18 E/F : MeOas -0.19579 1106.798 
JSOW 1.498 -0.25403 4.665 


Minuteman Il 3.096 -0.08508 34.847 
NAVSTAR 122.981 -0.16704 1.000 
MV-22 Osprey 125.966 -0.19754 197.694 


T-45TS 0.95 66.235 


MEDIAN 0.90 
MEAN 0.85 





Table B6. Base + Overhead Model R°adj and Fitted Parameters 


a2 


APPENDIX C: GAMS IMPLEMENTATION 


STITLE **PROCUREMENT SCHEDULE OPTIMIZATION MODEL (PSOM) ** 
(=== DEPAUL Sass a 9 oe eS 6 ee ee ee 
SOFFUPPER OFFSYMLIST OFFSYMXREF INLINECOM{ } 
OPTIONS RESLIM = 100000 
ITERLIM = 100000 
LIMCOL = 0 
LIMROW = 0 
DECIMALS = 2 
SOLPRINT = OFF 
MIP = CPLEX 
SYSOUT-= CFE 
OPTCR. =~.0005 
A EE SEER TA ee 
SONTEXT 
Original: 9/28/00 
Author: Donald E. Humpert 
Description: Base + Overhead Model 
Time period one = current year = 2000; 
Time period 19 = 2018; 
SOFFTEXT 


*---INDICES--------------~----------------------------------- 
SET 
a 


BRADLEY 
Ciy 
CH47F 
CRUSADER 
DDG5S1 
EELV 
FAILSEF 
JSOW 
PME 
NAVSTAR 
OSPREY 
SSN774 
STDMSL2 
T45TS 
TRIDENT2/ 


time periods / 1*19 / 
LRIP time periods / 1*3 / 


cost level /1*4/ 


. 
U 


ALIAS (t, 


——_—e@f8 @ ew www OO OO Ow eww OO ee ew eee e@e@ OS we ww ww HH eH SS Nw ew ww ewe ewe — 


PARAMETERS 
M(i) LRIP time periods for system i 

/BAAV pt 

CRUSADER 1/ 

QLRIP(i,p) number of units i in LRIP period p 

/BBRAV Ral 38 

CRUSADER .1 62/ 


Ds. 


CLRIP(i,p) procurement cost of system i in LRIP period p 


/ABAV rl 2.494 
CRUSADER .1 Seo s0/ 
INV (i) starting inventory of system 1 in period 1 

/RARAV 0 

ABRAMS 848 

BRADLEY 229 

ealy, 85 

CH47F 0 
CRUSADER 0 

DDG51 48 

EELV 1 

FAILSEF 98 

JSOW TOF 

MMIII 148 

NAVSTAR 0 

OSPREY 30 

SSN774 3 

STDMSL2 294 

T45TS E53 


TRIDENT2 o5/ 


MINR (1) min sustaining production rate for system i during FRP 
/ARRAV 20 
ABRAMS 20 
BRADLEY Zo 
C17 at 
CH47F 8 
CRUSADER 20 
DDG51 il 
EELV 4 
FAL8EF 2 
JSOW 100 
MMIII 10 
NAVSTAR 3 
OSPRE. 2 
SSN774 J. 
STDMSL2 60 
T45TS 1 
TRIDENT2 57 
MAXR (1) maximum production rate for system 1 during FRP 
/RAAV 200 


ABRAMS 120 
BRADLEY 235 


Cie? Ibe. 
CH47F Zo 
CRUSADER 240 
DDG51 5 
EELV 14 
FAILSEF 48 
JSOW 900 
MMITI 80 
NAVSTAR 3 
OSPREY 36 
SSN774 3 
STDMSL2 190 
T45TS Is) 


TRIDENT2 P27 


54 


EARLY (1) 


LATE (1) 


D{i, t} 


earliest period in which FRP may begin for system i 


/DARAV 
ABRAMS 
BRADLEY 
eae) 
CH47F 
CRUSADER 
DDG51 
EELV 
FA1L8EF 
JSOW 
MMIII 
NAVSTAR 
OSPREY 
SSN774 
STDMSL2 
T45TS 
TRIDENTZ 


latest period in which FRP may begin for system i 


/BAAV 
ABRAMS 
BRADLEY 
Cl7 
CH47F 
CRUSADER 
DDG51 
EELV 
FA18EF 
JSOW 
MMIII 
NAVSTAR 
OSPREY 
SSN774 
STDMSL2 
T45TS 
TRIDENT2 


required quantities of system i by period t 


/RAAV 
ABRAMS 
BRADLEY 
C17 
CH47F 
CRUSADER 
DDG51 
EELY. 
FAL8EF 
JSOW 
MMIII 
NAVSTAR 
OSPREY 
SSN774 
STDMSL2 
TA57TS 
TRIDENT2 


NONNMNNNNNNNN ND WH ND DND LN W 


~ 


16 


1 


NOMNNN ~JI NM NM ND ND ND 


a0 
a 
23 
Re) 
24 
3 
a6 
ae, 
5a 
oA 
a0 
aay 
14 
oe 
ele: 
ae) 
=6 


950 
Giles 
1602 

134 

300 
L650 
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5) 


FIXED (2) Fixed COStSecOmesystem 21 incurred if in frp 


/ARAV S123 42 
ABRAMS 219.906 
BRADLEY 23.401 
Cle 831.578 
CH47F 1-000 
CRUSADER So 2 
DDG51 280.7 91 
EELV i000 
FAL8EF 1106.798 
JSOW 4.665 
MMIII 34.847 
NAVSTAR i 000 
CSPREY 1972694 


SSN774 414.191 
STDMSL2 16.248 
T45TS 000 
TRIDENT2 822509 /7 


TABLE PRICE(21,¢€) price of system 1 at cost level c 


1 2 3 4 
AAAV o 2009 S22 15 Sasi se 4.5611 
ABRAMS S501] Sy ops age os Jol 323501 
BRADLEY 2.4411 221905 230235 T3015 
Giz foo.7082 162.9792 Po0-3270 Ibe Tis hss) 
CH47F eZ AS I Zoo o0 22357 B12 560 
CRUSADER fn oL63 5.5656 4.8550 4.4248 
DDG51 ol4.1985 630/336 613.3873 613.0102 
EELV 85.2563 Wom oe) 68.9474 Spel a A8 7! 
FAISEF 4725059 3822048 55.307 1 3322098 
JSOW 0.4063 Uessee Oazoe2 O22701 
MMIII e135 IOS 1.8466 1.3027 
NAVSTAR TG2323537 8223620 Ti Aye shemale 68.0108 
OSPREY 56.4472 47.9924 43.0960 39.7409 
SSN774 ipe7eo76> L470.2191 1339.4992” 12al piso 
ST DMSL2Z is Ope) ool? Oso olZ 0. 5802 
T45TS 2224053 22.2814 22 5UO a2 22.0484 


TRIDENT 2 2024 030 252005 L 24.0186 22.6009; 


TABLE LIMIT(i,c) min number of system i that must be procured at 
price c before any can be procured at price next c 


al 2 S) - 

AAAV LL? Z15 280 333 
ABRAMS 68 70 2 73 
BRADLEY 250 a7 876 430 
C17 11 12 13 13 
CH47F 34 66 89 Tee at 
CRUSADER 184 562 486 Sve 
DDG51 2 3 2 5) 
EELV 24 41 52 63 
FAL8SEF 85 104 22 139 
JSOW 1510 2030 2500 2943 
MMITS gL als, io 149 
NAVSTAR 6 9 WZ Ws) 
OSPREY 62 85 106 125 
SSN774 8, 6 | 9 
STDMSE2 2a Pag es Sei Sot 
T45TS 4 4 4 4 
TRIDENIZ a is 14 ile 


SCALAR BGT annual budget /25000/; 
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*-——-VARIABLES-—=-----—=-----—-__-_ -_. -- = aa ae oa 
VARIABLE 
TOTAL total procurement costs for all systems over all periods 


. 
4 


POSITIVE VARIABLES 


GQ (isse ne) units of system i procured in period t at cost level c 
Cum (age) cumulative units of system i procured by period t 
GOSi (275) cost of units of system i procured in period t 


. 
f 


BINARY VARIABLES 
Start(i,t) 1 if system i begins FRP in period t else 0 
Erp(i te) 1 if system iis in FRP in period t else 0 
Vale ee) 1 if system 1 available at price level c in period t else 0 


2 
s 


S33 OO ME EO) | I I 
EQUATIONS 
OBJ Objective Function 
PAYOUM G2 St } 
BUDGET (C) 
CUMQUANT (1, t) 
DEMAND (1, t) 
MINPROD (i,t) 
MAXPROD (1, t) 
EARLIEST (i) 
LATEST (1) 
NOBREAKS (1) 
FRPSTART (1, t) 
STECLUMS (a), bic) 
Sree ERS (i,t ye) 
SiePZbHS (i,t, c) 
STEPZRES (170, c) 
SiePoLesti, oC) 
STEPSRHS(1,t,¢) 
SaereRHs(1,t,;¢) 


*---OBJECTIVE FUNCTION------------------~------~-------------- 


O50... TOTAL =e= sum(i, sum(t, cost(i,t))); 
* ---CONSTRAINTS-------------------------------------~--------- 
Perour (i,t). . COSE(17 ©) =e= «sumic, q(i,t, G)=PRICE(a,ic)) + frp(i,t)* FIXED 
+ sumi(ps (ord(p) <=Miij 5 CLRIP(1,p) *start(1, &+( 14M) ordi) 
BUDGET (t).. BGT §=G-—) esumii,, Cost (1, t)) ; | 
BUMQUANT (1,t).. cumq(i,t) =e= INV(1i) 


fesum( too (Ord(tp)<=ord(t)), sSsumic, qi, tence 
+ sum(tp$S (ord(tp)<=ord(t)),  sum(p$(ord(p)<=M(i)), 
WLRIP(, >) start (2, tpt (14+M(i) —-orain 


DEMAND(1i,t).. cumq(i,t) =g= D(i,t); 

MENPROD (i,t) -. SUM(C, ici, ec) —G= f£rp(1,C) *MINR(1); 

MEXPROD (i,t). Sum(@y7 Gil, ec) l= Erp (i,t) *MAXR(i); 

BARGIEST (1). . sum(t, ord(t)*start(i,t)) =g= EARLY (i); 


Su) 


LATEST (1).. SUMCC meus Start(i,t)*) =l= LATE(1i); 


NOBREAKS(i).. sum(t, start(i,t)) =e= 1; 
FRPSTART (i,t).. Seat eee o—-e(fro(i,t) - frp(i,t-1)); 
SPEPLLHS (1), eee eee (i,t, 1") =l= sum(tp$ (ord (tp) <=cerd(t)), qi(i,tp,"1")); 


STEPZLHS (1, tees 2 (i,t, 2") =l= sum(tps (ord (tp) <=ord(t))), .qii,tp, "2"));¢ 


STEPSLHS (27 ty Geet oy (i,t,"3") =l= sum(tps (ord (tp) <=ord(t)}), q(i,tp,"3"))? 


STEPIRHS eo eemsum( toe (ord(tp)<=ord(t)), @q(i,tp,"17)) 


STEPC Roe eumemsum (tps (ord (tp) <=ord(t)), q(1,tpmei2 )) 


SI else tice wesum( tps (ord(tp)<=ord(t)), g(i,tp, 3 )) 


STerpanie (i, t,c) swsum( tps (ord (tp)<=ord(t)), qi{i,tp, 4") ) 


MODEL PSOM/ ALL /; 
file reportl;put reportl;reportl.pc=5; 
put reportl; 
put'ANNUAL BUDGET', 'TOTAL COST'/; 
put ‘SYSTEM QUANTITIES PER PERIOD, PER BUDGET'//; 
for(BGT = 22000 downto 12750 by 250, 
Solve PSOM using MIP MINIMIZING TOTAL; 
BISPLAY BUBGET .1; 
DISPLAY .c.1; 
put reportl; 
put BGT; 
put TOTAL. 1; 
Buty: 
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TM ET 2 po ee 


=l= LIMIT(i,%2") *y (3, Gee 


=l= LIMIT (a ,°3")'*y GPG, eee 


el= LIMIT(i,"4")*y (i,t, oor 
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